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BACKGROUND OF THE INVENTION 

Field of the invention 

This invention relates to moving image reproducing apparatuses knd, more 
particularly, to a moving image reproducing apparatus to be applied for i digital camera 
for reproducing a moving image comprising still images in a plurality of frames. 
Description of the prior art 

In the conventional digital camera having the function to reprodu::e moving 
images, when reproducing a moving image, still image signals in frames are first read out 
of a recording medium. The still image signals thus read are signal-processed and 
displayed on the display. Herein, serially executed are the processes of s Peking a desired 
address of the recording medium, reading still image signals from the des ired address and 
displaying still images on the basis of read still image signals. However, where the still 
image signals in frames are recorded in a sporadic form over the recording medium, the 
seek process takes longer time as the distance to an access address increases. 
Accordingly, in the prior art executing the seek, read and display processes serially, 
freeze possibly occurs in the reproduced moving image. 
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Therefore, it is a primary object of the present invention to provide a moving 
image reproducing apparatus capable of preventing against freeze in thej moving images 
reproduced. 

According to this invention, a moving image reproducing apparatus for 
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transfer process to 
from the recording 
the moving image 



takes a time, the 



reproducing a moving image signal from a recording medium, comprises: an internal 
memory for temporarily storing the moving image signal; and a multijtask CPU for 
concurrently executing, when inputted with a reproduce instruction, a 
transfer a predetermined amount per time of the moving image signal 
medium to the internal memory and a reproduce process to reproduce 
signal stored in the internal memory. 

When a reproduce instruction is inputted by the input means, tile multi-task CPU 
concurrently makes a transfer process of transferring a predetermined amount per time of 
a moving image signal from the recording medium to the internal memory and a 
reproduce process of reproducing the moving image signal stored in the internal memory 
Consequently, even if the transfer process for the moving image signa 
delay in time will not have effects upon the reproduce process. Accordingly, it is possible 
to properly reproduce a moving image signal without causing freeze therein 

In a certain embodiment of the invention, the reproduce process includes a set 
process to set a plurality of operation commands to a table and an output process to read 
out and output the moving image signal stored in the internal memory. On the other hand, 
the transfer process includes a seek process to seek a desired address cn the recording 
medium by making reference to the table and a signal transfer process to transfer the 
moving image signal corresponding to the predetermined amount from the recording 
medium to the internal memory by making reference to the table. That is, a plurality of 
operation commands are set to the table by the set process as part of the reproduce 
process. In the transfer process concurrent with the reproduce process, a desired address 
is sought by making reference to the table, wherein the moving image signal is transferred 



in a predetermined amount per time to the internal memory by making 
table. The moving image signal transferred to the table is outputted by 



reference to the 
the output process 
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as part of the reproduce process. In this manner, because a plurality of operation 
commands are stored in the table to fix the operation to be made in tHe transfer process, 
even where there encounters a delay in time due to the seek process, i signal transfer 
process can be promptly executed after the seek. 

Preferably, the reproduce process further includes a comparisckn process to 
compare the number of unexecuted operation commands already set in the table but not 
yet executed with a predetermined value and a wait process to wait for a predetermined 
time when the number of the unexecuted operation commands is greater than the 
predetermined value. When the number of unexecuted operation commands is increased, 
10 a wait process is effected. That is, the reproduce process is temporarily suspended. This 
makes the transfer process intensive to eliminate the delay in the transfer process. 
Incidentally, the predetermined value preferably relies on a moving-image frame rate. 

Preferably, the set process includes an update process to cyclically update a 
transfer destination address of the moving image signal and an address set process to set 
15 the transfer destination address updated by the update process to the 
updating the transfer destination address, a moving image signal can 
amount exceeding the capacity of the internal memory. 

Preferably, the moving image signal includes a plurality of coinpressed still image 
signals, and the output process including a decompress process to dec;ompress each of the 
20 compressed still image signals. By including the decompress proceds in part of the 
reproduce process, such an image signal as requiring a decompressic»n process can be 
properly reproduced regardless of time delay in the transfer. 

The above described objects and other objects, features, aspects and advantages of 
the present invention will become more apparent from the following detailed description 
25 of the present invention when taken in conjunction with the accompanying drawings 
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BRIEF DESCRIPTION OF THE DRAWIN^tS 

Figure 1 is a block diagram showing an embodiment of the 
Figure 2 is an illustrative view showing a mapping state in 
5 Figure 3 is an illustrative view showing a QuickTime file; 

Figure 4 is an illustrative view showing a sound-data offset 
Figure 5 is an illustrative view showing an image-data offset 
Figure 6 is an illustrative view showing an instruction list 
Figure 7 is a flowchart showing part of operation of the 
10 Figure 8 is a flowchart showing another part of operation 

embodiment; 

Figure 9 is a flowchart showing still another part of operation of the Figure 1 
embodiment; 

Figure 10 is a flowchart showing yet another part of operation of the Figure 1 
15 embodiment; 

Figure 11 is a flowchart showing another part of operation pf the Figure 1 
embodiment; 

Figure 12 is a flowchart showing still another part of operation of the Figure 1 
embodiment; 

20 Figure 13 is a flowchart showing yet another part of operation of the Figure 1 

embodiment; 

Figure 14 is a flowchart showing another part of operation 
embodiment; 

Figure 15 is a flowchart showing still another part of operation of the Figure 1 
25 embodiment; 



of the Figure 1 
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Figure 16 is a flowchart showing yet another part of operation of the Figure 1 
embodiment; and 

Figure 17 is an illustrative view showing part of operation o^ the Figure 1 
embodiment. 



EMBODIMENTS 



DETAILED DESCRIPTION OF THE PREFERRED 

Referring to Figure 1, a digital camera 10 of this embodime](it 
imager 12. The CCD imager 12 has a color filter (not shown) 
thereof. The optical image of a subject is illuminated to the CCD 

10 color filter. 

When a mode change switch 60 is shifted toward "CAMER4' 
54 establishes for a camera mode. A timing generator (TG) 14 prod 
the basis of the vertical and horizontal synchronizing signals oui 
generator (SG) 16, to drive the CCD imager 12 by the thin-out 

15 low-resolution camera signals in frames are outputted from the 

interval of l/30th of a second. The output camera signal is subjecti 
removal and level adjustment by a CDS/AGC circuit 18, and then 
data as a digital signal by an A/D converter 20. A signal processing 
YUV conversion on the camera data outputted from the A/D 

20 generating YUV data. Because the CCD imager 12 outputs camera 
frame at an interval of l/30th of a second, the YUV data (still image. 
is also outputted at an interval of l/30th of a second. The signal 
outputs the still image data thus produced, together with a write 
control circuit 26. 

25 A memory control circuit 26 writes the still image data to an 



tpuited 
; scheme. 



CCD 



ted 
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includes a CCD 
attached at a front surface 
ijnager 12 through the 

a system controller 
ijices timing signals on 
from a signal 
As a result, 
imager 12 at an 
to well-known noise 
ctonverted into camera 
circuit 22 performs 
ter 20, thereby 
signals for each 
data) for each frame 
circuit 22 
, to a memory 



processing < 



request 



SDRAM 28 in 



for 



response to the write request. The SDRAM 28 has a display imag^ 
Figure 2, to write therein the still image data. Because the display 
capacity of only one frame, the still image data for each frame is 
l/30th of a second. On the other hand, a video encoder 38 outputs 
5 interval of l/60th of a second. In turn, the memory control circuit 
data from the display image area 28a at an interval of l/60th of a 
image data for each frame is supplied to the video encoder 38 

The video encoder 38 converts the input still image data 
composite image signal and supplies the converted composite ima 

10 40. As a result, a moving image (through-image) of the subject is 
the monitor 40. 

When the operator presses shutter button 58, the system 
CPU 32 to record a moving image and sound. Thereupon, the 
compression commands and sound processing commands at an 

15 second. The image compression commands are supplied to a JPEC[r 
sound processing commands are to the signal processing circuit 

The JPEG CODEC 30 outputs a read request to the memoijy 
response to the image compression command. Consequently, the 
on the display image area 28a of the SDRAM 28 is read out at an 

20 second by the memory control circuit 26. The read still image 

JPEG CODEC through the bus 24a where it is subjected to JPEG 
JPEG CODEC 30, each time of producing a frame of compressed 
memory control circuit 26 to write the compressed image data for 
memory control circuit 26. In response, the memory control circuit 

25 compressed image data for each frame into a compressed-image 



area 28a as shown in 
image area 28a has a 
uj^dated at an interval of 
read requests at an 
26 reads still image 
Second. The read still 
through a bus 24a. 

each frame into a 
ge signal to a monitor 
displayed real-time on 



; data 



controller 54 instructs the 
CPy 32 generates image 
interval of l/30th of a 
CODEC 30 while the 

:4<^. 

control circuit 26 in 
still image data stored 
interval of l/30th of a 

is provided to the 
compression. The 
image data, requests the 
each frame to the 
it 26 writes the 
ariea 28b shown in Figure 
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control 



reads 
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On the other hand, the signal processing circuit 46 fetches a 
microphone 42 in response to a sound processing command. The 
subjected to a predetermined process, and the processed sound dat^ 
5 with a write request, to the memory control circuit 26. Because 

commands are provided at an interval of l/30th of a second, souncjl 
l/30th of a second, i.e. 266 bytes, is outputted to the memory 
memory control circuit writes the 266-byte sound data to a sound 
Figure 2, in response to the write request. 

10 The CPU 32 also requests the memory control circuit 26 to 

responsive to the given request, the memory control circuit 26 
sound data in amount of 1/lOth of a second and image data in 
records the read data onto a removable disk recording medium 36 
optical disk 36, through an I/F 34. 

15 In a memory card 36, a QuickTime-formed file header is 

first operation of the shutter button 58. The sound data and image 
SDRAM 28 are written to a position following the file header, 
sound chunk comprising 1/lOth-of-a-second sound data and an i 
3-frames compressed image data. One sound chunk and the folio 

20 correspond to each other. To an index chunk formed at the last of 
address of each sound chunk and start address of the compressed 
frame. Due to the index chunk, the sound data is put under control 
of a second while the compressed image data is put under control 
frame. 

25 When the shutter button 58 is shifted off, the CPU 32 sus 



sound signal through a 
fetched sound signal is 
is outputted, together 
sound processing 
data in amount of 
circuit 26. The 
area 28c shown in 



read out data. In 
out, alternately, 
of three frames, and 
such as a magneto- 



This 



image - 



created in response to the 
data read from the 
is alternately forms a 
chunk comprising 
ving one image chunk 
t|he file is written a start 
mage data for each 
at an interval of 1/lOth 
at an interval of one 



pends the JPEG CODEC 
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30 from outputting image compression commands and the signal processing circuit 46 
from outputting sound processing commands. That is, the data w rite process to the 
SDRAM 28 is suspended. However, the recording process is endsd when all the data in 
the SDRAM 28 has been recorded onto the magneto-optical disk 36. 

Incidentally, the file management scheme in the magneto-ctptical disk 36 employs 
an MS-DOS FAT scheme to sporadically record the QuickTime file on a cluster-by- 
cluster basis. 

When the operator shifts the mode set switch toward "REPRODUCE" and 
operates a set key 56, reproduced is a QuickTime file having been recorded in the 
magneto-optical disk 36 in the above procedure. First, the CPU 32 reads sound data and 
image data out of the next address to the file header in the Quickl 'ime file, and supplies 
the read sound data and compressed image data, together with a w rite request, to the 
memory control circuit 26. The sound data and the image data are written to the SDRAM 
28 by the memory control circuit 26. Because the QuickTime file is formed as shown in 
Figure 3, sound data in amount of 1/lOth of a second and compressed image data in 
amount of 3 frames are alternately provided from this file. The sound data is written in 
order starting from a top of a sound area shown in Figure 2, while the compressed image 
data is written in order starting from a top of a compressed image area 28b shown in same 
Figure 2. 

When a decompress command is supplied from the CPU 32 to the JPEG CODEC 
30, the JPEG CODEC 30 requests the memory control circuit 26 to read out a frame of 
compressed image data, and decompresses by a JPEG scheme the c;ompressed image data 
read from the compressed image area 28b by the memory control circuit 26. The JPEG 
CODEC 30 furthermore provides the decompressed image data, tc>gether with a write 
request, to the memory control circuit 26. The decompressed imajje data is written to a 



-8- 



display image area 28a shown in Figure 2 by the memory control 
generates decompress commands at an interval of l/30th of a 
CODEC 30, in turn, decompresses the succeeding frames of 
the above procedure each time a decompress command is given 
5 decompressed image data in the display image area 28a is updated 
of a second. 

The decompressed image data stored in the display image 
twice per time based upon the read request outputted at an interva 
from the video encoder 38. The read out is made by the memory 

10 the video encoder 38 converts the decompressed image data thus 
composite image signal. The converted composite image signal ii 
monitor 40 with a result that a moving image having normal-speec 
on the screen. 

The CPU 32 also supplies a sound-data reproducing 

15 processing circuit 48 in response to the system clock. The signal 
each time given a reproducing command, provides the memory 
request to read sound data in amount of 1 byte and makes a predet[' 
process on the sound data read from the sound area 28c by the 
The sound signal thus reproduce-processed is outputted through a 

20 Incidentally, the SDRAM 28 operates as a ring buffer in 

reproduce modes. That is, the destination address is cyclically 
each of the compressed image area 28b and the sound area 28c. 
to record/reproduce compressed image data in amount exceeding 
compressed image area 28b and sound data in amount exceeding 

25 sound area 28c. 



seccind 



compressed i 



4ircuit26, The CPU 32 
and the JPEG 
image data in 
Consequently, the 
at an interval of l/30th 

^rea 28a is read out 

of l/60th of a second 
tontrol circuit 26, and 
i[ead out into a 
supplied to the 
moving is reproduced 

; commland to the signal 

processing circuit 48, 
cc(ntrol circuit 26 with a 
ermined reproducing 
merjaory control circuit 26. 
speaker 52. 
bcith the record and 
renewed in a ring form in 
Diie to this, it is possible 
the capacity of the 
the capacity of the 



-9- 



tely 



When shifting the mode set switch toward "REPRODUCE 
operated, the CPU carries out a reproduce process shown concre 
16 and a background process shown in Figure 17. The CPU 32 is 
task OS (real-time OS), such as H iTRON, to concurrently execute 
and a background process. 

Herein the process of the CPU 32 uses variables shown in 
Table 1 lists variables related to sound, table 2 variables related to 
variables related to background processes. 

Table 1 



" and the set key 56 is 
in Figure 7 to Figure 
installed with a multi- 
a reproduce process 



Table 1 to Table 3. 
images and Table 3 



chk 


CHUNK NO. 


aof st [chk] 


OFFSET 


aszCchk] 


CHUNK SIZE 


acnt 


SOUND-DATA COUNT VALUE 


AMAX 


SOUND-DATA TOTAL BYTES 


AUD_BUF 


SOUND-AREA HEAD ADDRESS 


AUD_END 


SOUND-DATA LAST ADDRESS 


apreptr 


SOUND WRITE ADDRESS 


acptr 


SOUND REPRODUCE ADDRESS 


dm 


REMAINING CAPACITY VALUE 


astart 


INTERRUPT PERMIT FLAG 


af Ig 


SOUND-WRITE PROHIBIT FLAG 



10 



15 
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Table 2 



p ref rm 


WRITE FRAME NO, 


T rm 


nnr*n/\rM i/^f" r"n*iir" 

REPRODUCE FRAME NO. 


moTs t LPreT rmj 


OFFSET 


msz [pref rm] 


FRAME SIZE 


men t 


FRAME COUNT VALUE 


MFMAY 
nfirivinA 


TOTAL NUMBER OF FRAMES OF 
IMAGE 


MOV_BUF 


COMPRESSED- IMAGE-AREA TOP 
ADDRESS 


MOV„END 


COMPRESSED- IMAGE-AREA LAST 
ADDRESS 


mpreptr 


IMAGE WRITE ADDRESS 


mcptr 


IMAGE REPRODUCE ADDRESS 


decf Ig 


IMAGE-DECOMPRESS PERMIT 
FLAG 



Table 3 



S-mai l_No 


SET MAIL NO. 


E-mai l_No 


EXECUTE MAIL NO. 


mai l_min 


MIN. MAIL NO. 


mai l_cnt 


MAIL COUNT VALUE 


MAX_MBOX 


TOTAL NUMBER OF MAILS TO BE 
SET 


Rem_Mal 1 


NUMBER OF UNPROCESSED MAILS 



consideration, 
count 



10 



In Table 1, chk is a chunk no. of a sound chunk, aofst[chk] 
address of the QuickTime file to a top of a sound chunk under 
is a size (bytes) of a sound chunk under consideration, acnt is a 
as represented in bytes, and AMAX is total bytes of the sound data 
QuickTime file. AUD_BUF and AUD_END are respectively a top 
address of the sound area 28c. apreptr is a write address to the souhd 



is offset of from a top 
ion, and asz[chk] 
value of sound data 
stored in the 
address and a last 
area 28c, acptr is a 
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data 



co: 



read (reproduce) address from the sound area 280, and dm is a 
of the sound area 28c. astart is a flag to represent whether to pemjiit 
or not, and aflg is a flag to represent whether to prohibit from 
28c or not. 

5 In Table 2, prefrm is a frame no. of compressed image dat£. 

compressed image area 28b, and frm is a frame no, of compressed 
(reproduced) from the compressed image area 28b. mofst[prefrm 
address of the QuickTime file to a top address of compressed imag|e 
consideration, and msz[prefrm] is a size of compressed image 

10 consideration, mcnt is a count value on the number of frames of 

and MFMAX is a total number of frames of the compressed imag^ 
QuickTime file. MOV_BUF and MOV_END are respectively a 
address of the compressed image area 28b. mpreptr is a write 
image area 28b5 and mcptr is a read (reproduce) address from the 

15 28b. decflg is a flag to represent whether to permit a decompressed 
compressed image data. 

In Table 3, S-mail_No is a mail no. representative of a write 
a command to an instruction list 34c shown in Figure 6, and E 
showing a read destination in executing a command set in the i 

20 mail__min is a minimum mail no., and mail_cnt is a mail-no. counl: 
a total number of mails (commands) to be set in the instruction lisi: 
the number of mails already set in the instruction list 34c but not ] 

Referring to Figure 7, in step SI a sound offset table 32a 
image offset table 32b shown in Figure 5 are produced on the 

25 information written in the index chunk shown in Figure 3. The 



reniiammg capacity value 
an interrupt process 
to the sound area 



top 



address 



-mail 



: bas: s 



to be written to the 
image data to be read 
is offset of from a top 
data of a frame under 
of a frame under 
mpressed image data, 
data stored in the 
address and a last 
to the compressed 
<|:ompressed image area 
process on 



destination in setting 
il No is a mail no. 
instlruction list 34c. 

value. MAX_BOXis 
34c, and Rem_Mail is 
jtt processed, 
s^own in Figure 4 and an 

of the address 
sdund offset table 32a is 
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. sizes 



ifically. 



image 



instruction 



written with offsets aofst[chk] and chunk sizes asz[chk] of sound 
offset table 32b is written with offsets mofst[prefnn] and data 
frames of compressed image data. 

Next, in step S3 various variables are initialized. Speci: 

5 the chunk no. chk is set at "0". The sound reproduce address acptjr 
address apreptr is made coincident with a top address AUD_BUF 
Then, the interrupt-permit flag astart and the sound-write prohibit 
For the image data, the reproduce frame no. frm is made coincident 
no. prefrm. The image reproduce address mcptr and image write 

10 coincident with a top address MOV__BUF of the compressed 
image decompress-permit flag decflg is set at "0". For the i 
S-mail__No, minimum mail no, mail_min and mail count value 
In step S5, Equation 1 is operated to determine a sound 
the succeeding step S7, the calculated count value acnt is compare^ 

15 of the sound chunk corresponding to the current chunk no. chk. 

step S9 the size asz[chk] of the current sound chunk is subtracted 
count value acnt. In step Sll, the size asz[chk] of the current 
from the total bytes AMAX of the sound data. Then, in step S13 
incremented. If the process of step S13 is ended, the process 

20 acnt = (sample X frm) / fps ...(1) 

sample: the amount of sound data corresponding to one 
^s: moving-image frame rate 

By Equation 1, an address of sound data corresponding to 
(current frame) being displayed at present on the monitor 40. It 
25 to be determined herein is an address on the assumption that the 



iphunks. The image- 
msz[prefrm] of 



mail 



-data 



, for the sound data, 
and sound write 
of the sound area 28c. 
flag aflg are set at "0". 
with the write frame 
address mpreptr is made 
area 28b. Then, the 
list, the set mail no. 
_cnt is set at "0". 
count value acnt. In 
with the size asz[chk] 
acnt ^ asz[chz], in 
from the calculated 

chunk is subtracted 
the chunk no. chk is 
to the step S5. 



If 



sound 



returns 



fr^me (bytes) 

still image in the frame 
is noted that the address 
!50und data continues 
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commands 



ship 



from the top and not necessarily agrees to an address on the 
Figure 3. Accordingly, the process of the steps S9 to S13 is 
acnt < asz[chk] in the step S7. This reveals in what numbered 
sound chunk a desired address exists, 
5 If acnt < asz[chk] is determined in the step S7, in step 15 

AMAX is determined. The step S15 is a process to determine 
transfer commands have been set to the instruction list 32a or not 
represents a last address of the last sound chunk, the total bytes 
At this time, it is considered that all the sound-data transfer 

10 the process advances to step S21. In the step S21, determination 
sound- write-prohibit flag aflg. If alfg = 0, aflg = 1 is given in 
proceeds to step S45. If aflg = 1, the process directly proceeds to 
sound-write-prohibit flag aflg shows "0", then it is considered 
transfer commands have been set but transfer command of co: 

15 yet completed, and the process advances to step S45. At this ti 
provided in step S23, determination of "YES" is made in the stejjt 
time. 

It is determined in step S17 whether Equation 2 stands or 
process to determine whether the data to be set with the next 
20 data or compressed image data. 

aofst[chk] + acnt < mofst[prefrm] •••(2) 
As hereinafter described, when sound-data transfer 
chunk is set to the instruction list 32a or a compressed-image- 
amount of 3 frames is set to the instruction list 32a, inverted is 
25 magnitude between "aofst[chk] + acnt" and "mofst[prefrm]" 



QuickTime file shown in 
repeated before determining 
:e of what numbered 



Due 



a value of total bytes 
whether all the sound-data 
, If the count value acnt 
AKiAX will represent "0". 
have been set, and 
is made on a state of the 
S23 and then process 
stepS61. That is, if the 
thlat all the sound-data 
mpressed image data is not 
tinje, because aflg = 1 is 
S21 process in the next 



not. The step S 17 is a 
trailisf er command is sound 



comniand in amount of one 
transfer command in 
relationship in 
to this, it is determined 



data 



the: 
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whether the next transfer command is to be set for sound data or 
depending upon whether Equation 2 stands or not. When setting i 
is determined in step S17, and in step S19 whether Equation 3 st4nds 
apreptr + asz[chk] - acnt - 1 <AUD_END - (AUD_END 



compressed image data 
for sound data, "YES" 

or not. 
AUD_BUF) / MG 
■ (3) 



artia 



AUD 



address 



S19. 



MG: margin coefficient on sound area 28c 
At the first write to the sound area 28c, a sound-margin 
is formed in the last end of the sound area 28c. (AUD_END - 
represents a size of the sound margin area. On the other hand, the 
an address represented by the current count value acnt and last 
to which that address belongs has size "asz[chk] - acnt". In step 
whether the sound data corresponding to this "asz[chk] - acnt" car 
current sound write address apreptr and a sound-margin-area top 
Incidentally, in Equation 3 is due to consideration that the 
begins at "0". 

If "NO" herein, all the sound data has not been completed 
setting. However, it is considered that the transfer command 
insufficient capacity of the sound area 28c, and process advances 
other hand, if "YES" is determined in step S19, it is considered 
sound area 28c is sufficient, and the process proceeds to step S29 

In the step S29, an operation "HEAD SEEK" and a file 
are set to the instruction list 32a shown m Figure 6. In the 
count value mail_cnt is incremented. Furthermore, in step S33 
an SDRAM address "apreptr" and a size "asz[chk] - acnt" are set 
32a. In step S35, the mail count value mail__cnt is again incremenlted 



an 



as shown in Figure 2 
BUF) / MG 
sound data of between 
of the sound chunk 
, it is determined 
be stored in between a 
Address or not. 

area 28c in address 



sound 



m transfer command 
canijot be set because of 
tostepS21. On the 
thkt the capacity of the 

addiess "aofst[chk] + acnt" 
succeelling step S31, the mail 
operation "WRITE", 
the instruction list 



toi 
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Because setting of sound-data write corresponding to "as2: 
completed, in the step S33 in step S37 "asz[chk] - acnt" is added 
write address apreptr. In step S39, the size of the current sound 
subtracted from the total bytes AMAX. Thereafter, in step S41 
5 rendered "0", and in step S43 the chunk no, chk is incremented 
returns to the step S15. 

Incidentally, the count value acnt is a variable used to 
destination address upon starting reproducing at a midway of a 
to this, transfer setting of the sound data belonging to this count 

10 completed, the count value acnt becomes "0" and is meaningless 
In the above steps S29 and S33 as well as the hereinafter-* 
S105, S109, S112, S115, S127 and S129, a subroutine shown in 
First, in step S151 a desired command (instruction) is added to a 
mail no. S-mail_No. Next, in step S153 the set mail no. S-mail 

15 step S155 the number of unprocessed mails Rem__Mail is 
incremented set-mail no. S-mail_No is compared with the 
MAX_BOX. If S-maiLNo < MAX__BOX herein, the process 
S161. However, if S-mail_No = MAX_BOX, in step S159 the 
returned to "0" and then the process advances to step S161. It is 

20 S161 whether the number of unprocessed mails Rem_Mail is e 
mails MAX_BOX or not. If "NO", the process directly returns 
considered that an error occurred, and the process is forcibly 

In step S15 shown in Figure 7, when the total bytes 
renewal process of the step S39, the process proceeds to step 

25 determination process of "YES". On the other hand, if the total 



[chk] - acnt" has been 
to the current sound 
ihunk "asz[chk]" is 
flhe count value acnt is 
^d then the process 



Noi 



incremented 



number 



set- 



S21 



spqcify an access- 
ctoain sound chunk. Due 
chunk has been 

described steps S45, S49, 
Figure 14 is processed, 
^olumn of a currently set 
is incremented, and in 
In step S157, the 
of settable mails 
directly proceeds to step 
-mail no. S-mail_No is 
determined in the step 

to the total number of 
However, if "YES", it is 



qual I 



ended. 



AMAX become "0" due to the 
through the 
bytes AMAX have not 
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decreased down to "0", the process advances to step S25 througli the determination 
process of "NO" in step S17. That is, because Equation 2 becomes not standing due to the 
renewal of chunk no. chk in the step S43, the process proceeds to step S25. In the step 
S25, the frame no. prefrm of the compressed image data to be wiitten to the compressed 
image area 28b is compared with the total frames MFMAX. If prefrm = MFMAX, the 
process proceeds to step S61 while, if prefrm < MFMAX, it is d<!termined in step S27 
whether Equation 4 stands or not. 

mpreptr + msz[prefrm] - 1 < MOV_END_(MOV_END - MOV_BUF) / MG . . .(4) 

Similarly to the above sound area, at a first write of comp ressed image data to the 
SDRAM 28, an image margin area shown in Figure 2 is formed at the last of the 
compressed image area 28b. (MO V_END - MOV_BUF) / MG in Equation 4 represents a 
size of the image margin area. The step S27 determines as to whether the compressed 
image data in amount of a frame corresponding to "msz[prefrm]" can be stored between a 
current image write address mpreptr and a top address of the image margin area or not. 

If Equation 4 is not fulfilled, the process proceeds to step S61 similarly to the 
determination of prefrm = MFMAX. On the other hand, if Equation 4 is fulfilled, the 
process proceeds to step S45 to set an operation "HEAD SEEK" iind file address 
"mofst[prefrm]" to the instruction list 32a. Subsequently, in step S47 the mail count 
value mail_cnt is mcremented. In step S49, an operation "WRITIB", SDRAM address 
"mpreptr" and size "msz[prefrm]" is set to a column of the instnic;tion list 32a 
corresponding to the current mail count value. Completing the set process, in step S51 
the mail count value mail_cnt is again incremented. 

In step S53, "msz[prefnn]" is added to the current image wj ite address mpreptr. In 
the succeeding step 855, the current write frame no. prefrm is incremented. Thereafter, it 
is determined in step S57 whether Equation 5 stands or not. If "NO", the process directly 
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returns to the step S15. However, if "YES", a minimum mail no, 
coincident with the mail count value mail__cnt and then the process 
prefrm - frm < fps • -(5) 

Equation 5 stands when the difference between the write 
5 reproduce frame no. (frame no. of a displayed still image) frm is 

rate. Due to this, as long as the compressed image data completed 
instruction list 32a but not yet reproduce-processed (decompression 
is below "30", the minimum mail no. mail__min is incremented 
value mail_cnt. However, if the setting process to the instruction 

10 high speed and the above difference becomes greater than "30", 
mail_min is suspended from being incremented. 

Referring to Figure 17, the chunk no. chk is incremented 
command of sound data in amount of one chunk is set to the instruction 
other hand, the write frame no. prefrm is incremented each time 

15 compressed image data in amount of one frame is set to the instriiction 
Consequently, the top address of the sound chunk under consideration 
of the frame under consideration are inverted in positional relatii^nship 
completing the transfer setting of sound data in amount of one clliunk. 
completing the transfer setting of compressed image data in amcjunt 

20 Accordingly, alternately set in the instruction list 32a are a trans: 

data in amount of one chunk and a transfer command of compressed 
amount of three frames in the order the address of the QuickTin:^e 

In step S61 shown in Figure 10, it is determined whether 
When moving to the step S61, both the mail count value mail 

25 no, mail_min take fixed values. On the other hand, the number 



frame no. prefrm and a 
below "30" of the frame 
in setting to the 
process) in frame no. 
fi|)llowing the mail count 
list 32a is executed at 
the minimum mail no. 



cut 



mail__min is made 
returns to the step S15. 



each time a transfer 

list 32a. On the 
k transfer command of 
list 32a. 
and the top address 

each time 
, or each time 
of three frames, 
fer command of sound 
image data in 
file increases, 
liquation 6 stands or not. 

and the minimum mail 
6f unprocessed mail 
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not 



tlie 



Rem_Mail is decremented each time the transfer command is 
process, hereinafter described. 

Rem__Mai > mail__cnt - mail ... (6) 

Equation 6 stands when the number of unprocessed mails 
number of commands already set in the instruction list 32a but 
excessive in the number. In such a time, the process waits for a 
step S63 and thereafter processes agam the step S61. Due to the 
the CPU 32 devotes itself to the background process and hence 
unprocessed mails Rem_Mail swiftly decreases. When Equation 
due to this, the process advances to step S65. 

As discussed above, the mail count value mail__cnt and 
mail_min is fixed when the process moves to the step S61, Thus 
represents a certain fixed value. Herein, non-coincidence will 
count value mail_cnt and the minimum mail no. maiLmin when 
the write frame no. prefrm and the reproduce frame no. frm 
difference between the both increases from then on each time a 
Where the QuickTime file is sufficiently great in size as compared 
SDRAM 28, the difference value is fixed when Equation 3 or 
fulfilled. Thus, the difference value, i.e. value of "mail_cnt - 
the frame rate and the capacity of SDRAM 28. More specifically 
represented by "mail_cnt - mail_min" the slower the frame rate 

In step 865, determination is made on a state of an image 
decflg. If decflg = 0, the process directly advances to step S69. 
determined in step 567 that the JPEG decompression process in 
been completed, and the process proceeds to step S69. hi the 



executed by a background 



Rem_Mail, i.e. the 

yet executed, is 
]Dredetermined period in 
waiting in the step S63, 

number of 
6 becomes not satisfied 



occur i 



exce(5ds 



Equal 



mail 



- step 



minimum mail no. 

, "mail_cnt - mail_min" 

between the mail 
the difference between 
the frame rate. The 
tijansfer command is set. 
to the capacity of the 
ion 4 becomes not 
._min", is regulated by 
, the greater the value 
bbcomes. 
decompress permit flag 
decflg = 1, it is 
afciount of one frame has 
S69, determination is 



If( 
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made for an input of a vertical synchronizing signal occurring at an interval of l/30th of a 
second. In response to a determination result of the presence of an input, the process 
proceeds to step S71. In step S71, determination is made on a state of an interrupt permit 
flag astart related to the sound data process. If astart = 1, the process directly proceeds to 
step S75 while, if astart = 0, in step S73 astart is set at "1" and then the process advances 
to step S75. 

In the step S75, the JPEG CODEC 30 is instructed to decompress the compressed 
image data in amount of one frame written in the compressed image area 28b in a position 
following the image reproduce address mcptr. The JPEG CODE C 30 performs a 
decompression process in the above manner. As a result, the con esponding still image is 
displayed on the monitor 40, In step S77, the image-decompress permit flag decflg is set 
to "1" in order to make a determination "YES" in step S65 in the next time. Subsequently, 
in step S79 the image reproduce address mcptr is updated, i.e. thts size of the compressed 
image data thus decompression-processed msz[frm] is added to the current image 
reproduce address mcptr. In step S81 the reproduce frame no. frm is incremented, and it 
is determined in step S83 whether Equation 7 is fulfilled or not. 

mcptr + msz[frm] - 1 < MOV_END . . .(7) 

When Equation 7 is fulfilled, the compressed image data of the next frame is 
stored in a position following the updated image reproduce address mcptr. On the other 
hand, when Equation 7 is not fulfilled, the compressed image data of the next frame is 
stored in a position following the top address MOV__BUF of the compressed image area. 
Consequently, if "YES" in the step S83, the process directly proceeds to step S87. 
However, if "NO", a top address MOV_BUF is set in the image reproduce address mcptr 
in step S85 and then the process advances to step S87. 

The reproduce process of sound data is incremented according to an interrupt 
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25 



control circuit 26 and 
address acptr of the 



routine shown in Figure 15. The interrupt process is started in response to a clock of 7990 
Hz (sound-sampling frequency). First, it is determined in step SI 71 whether the interrupt 
permit flag astart is "1 " or not. If herein astart = 0, the process diiectly returns to the main 
routine. However, if astart = 1, in step S173 a sound reproduce command is delivered to 
5 the signal processing circuit 48. In response to the sound reproducing command, the 
signal processing circuit 48 provides read request to the memory 
reads sound data in amount of 1 byte out of the sound reproduce 
sound area 28c. A predetermined process is made on the read-oi t sound data, and the 
processed sound signal is outputted through the speaker 52. In step S175, the sound 

10 reproduce address acptr is incremented. In step S177, the sound reproduce address acptr 
after update is compared to the last address AUD_END of the sound area 28c. If herein 
acptr ^ AUD_END, it is considered that the sound data in the nes^t byte has been written 
in the updated sound reproduce address acptr, and the process directly returns to the main 
routine. On the contrary, if acptr > AUD_END, it is considered that the next byte of 

15 sound data has been written in the top address AUD_BUF of the iiound area 28c. In step 
SI 79, a top address AUD_BUF is set to the sound reproduce addi ess acptr, and then the 
process returns to the main routine. 

Referring back to Figure 11, in step S87 the current frame 
with the total number of frames MFMAX. If frm = MFMAX, it is 



no. frm is compared 
considered that there is 



20 no compressed image data in the next frame, and the process adviinces to step S99 by 



waiting for the determination in step S97 that the current frame of 



::ompressed image data 



has been completed in decompression process. In the step 899, determination is made on 
a state of the interrupt permit flag astart. If astart = 0, the process is ended as it is. 
However, if astart = 1, in step SlOl this interrupt permit flag astart is returned to "0" and 
thereafter the process is ended. 
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' not, 
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MEVIAX 



1 that 



; ste 3 



If determined "NO" in the step S87, in step S89 the write 
compared with the total number of frames MFMAX. If prefrm = 
determined in step S91 whether the total bytes AMAX is "0" or 
prefrm < MFMAX, it is determined in step S93 whether the total 
5 not. If prefrm = MFMAX and MAX = 0, then it is considered 
setting has been completed for all the compressed image data 
process returns from the step S91 to the step S65. If prefrm = 
otherwise prefrm < MFMAX and AMAX > 0, it is considered 
a transfer command is left, and the process advances from the 

10 S95. Then, the current sound-chunk offset aofst[chk] is compared 
image-data offset mofst[prefrm] corresponding to the current wrij:e 
Depending on a comparison result, the process proceeds to step 
< MFMAX but AMAX = 0, it is considered that the data to be set 
command is only the compressed image data, and the process 

15 to step S123. 

In the step SI 03, it is determined whether Equation 8 is 
apreptr + asz[chk] - 1 < AUD_END . . .(8) 
When Equation 8 stands, there is a vacant capacity capable 
data of the current sound chunk in the position following the 

20 apreptr. In this case, in step Sill "0" is set to a remaining capacity 
S112 an operation "HEAD SEEK" and file address "aofst[chk]" 
list 32a, and then the process proceeds to step S113. On the 
not stand, the sound data of the current sound chunk, except for 
be written to the position following the current sound write address 

25 in step S105 an operation "HEAD SEEK" and file address " 



; cunent 



IS 



cont:ary. 



one 



'^aofst[chk] 



frame no. prefrm is 
MFMAX, it is 

On the other hand, if 
bytes AMAX is "0" or 
transfer command 
sound data, and the 

butAMAX>0or 
the data to be set with 
S91 or S93 to the step 
with a compressed- 
frame no. prefrm. 
orS123. If prefrm 
with a transfer 

from the step S93 



S103 



advances 



ftjlfilled or not. 

of writing all the sound 
write address 
value dm, and in step 
set to the instruction 
if Equation 8 does 
part thereof, cannot 
apreptr. In this case, 
" is set to the 
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dm 



i process 



instruction list 32a. In step SI 07, a remaining capacity value dm 
to Equation 9, and in step S109 an operation "WRITE", size 
"apreptr" is set to the instruction list 32a. Completing the 
process advances to step SI 13. 
5 dm = (AUD_END - apreptr +1) ... (9) 

In step S113, the top address "AUD_BUF" of the sound 
sound write address apretr. In the succeeding step SI 15, an 
SDRAM address "apreptr" and size "asz[chk] - dm" is set to the 
step SI 17, the sound write address apreptr is updated according 
10 apreptr = apreptr + asz[chk] - dm ... (10) 

Thereafter, in step SI 19 the current sound-chunk size asz 
the total bytes AMAX, and in step S121 the chunk no. chk is 
returns to the step S93. 

In this manner, if there is a vacant capacity capable of 
15 amount of one chunk in position following the sound write 

SI 15 a command for transferring sound data in amount of one 
instruction list 32a. On the other hand, if there is no vacant 
sound data in amount of one chunk in position following the 
in step S109 a command for transferring part of the sound data is 
20 32a, and in step SI 15 a command for transferring the remaining 
instruction list 32a, After returning from the step S121 to the stei^ 
to step S123 directly or through the step S95. 

In the step SI 23, it is determined whether Equation 11 is 

mpreptr + msz[prefrm] - 1 < MOV_END . . .(11) 
25 If Equation 11 is fulfilled, it is considered that the co: 



is determined according 
" and SDRAM address 
of the stepS109, the 



area 28c is set to the 
operation "WRITE", 

instruction list 32a. In 
to Equation 10. 

[chk] is subtracted from 
incremented and the process 

writing sound data in 
address apreptr, then in step 

ctiunk is set to the 
capacity capable of writing 
soujid write address apreptr, 
set to the instruction list 
sound data is set to the 
S93, the process moves 

fulfilled or not. 



mprijssed image data in 
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address 



piocess 



amount of one frame can be written to the position following the 
address mpreptr, and the process directly advances to step S127. 
fulfilled, the top address MOV_BUF is set to the image write 
write compressed image data in amount of one frame to a position 
5 address MOV_BUF. Ending the process of the step S125, the 

S127. In step S127, an operation "HEAD SEEK" and file addres^ 
to the instruction list 32a. In the succeeding step S129, an operation 
address "mpreptr" and size "msz[prefrm]" is set to the instruction 
step S131 the size msz[prefrm]" is added to the current image wi[ite 
10 in step S133 the write frame no. prefrm is incremented. 

In step S135, it is determined whether Equation 12 is 
is the same as above-mentioned Equation 6. 

Rem__Mail > mail_cnt - mail_min . . .(12) 
When Equation 12 is not fulfilled, the number of unprocessed 
15 and accordingly the process returns to the step S65 without passiiji, 
On the other hand, when Equation 12 is fulfilled, in step S137 
astart is set to "0" to interrupt the reproducing of sound data in olrder 
background process. In step S139 a predetermined time is waited 
predetermined time, the process proceeds to step S141 to 
20 is fulfilled or not, i.e. whether the number of unprocessed mails is 
Rem_Mail > (mail_cnt - mail_min) / 2 . . .(13) 
If Equation 13 does not stand, the process of the steps 
wherein the process returns to the step S65 when Equation 13 is 
By returning to the step S65, the process of decompressii^j 
25 data is again executed. Also, when the process of reproducing soimd 



current image write 
If Equation 11 is not 
mpreptr in order to 
following the top 

proceeds to step 
"mofset[prefrm]" is set 
"WRITE", SDRAM 
list 32a. Thereafter, in 
address mpreptr, and 

fulfilled or not. Equation 12 



S139 



mails is not so much 
gthe steps S137-S141. 
interrupt permit flag 
for devotion to the 
for. Elapsing the 
ne whether Equation 13 
reduced to a half or not. 



and S141 is repeated, 
fulfilled. 

g the compressed image 
data is interrupted in 
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sU as the transfer setting 
and S129 of Figure 13 



order for devotion to the background process, the sound reprodi^cing process is resumed 
by the process of the step S73. 

In this manner, the transfer setting of sound data in amoijnt of one chunk in the 
steps S112 and S115 or S105, S109 and S115 of Figure 12 as w 
5 of compressed image data in amount of one frame in steps S127 

are made each time completing the process of decompressing co mpressed image data in 
amount of one frame. On the other hand, sound data is reprodu(;ed byte by byte in 
response to the clock of 7990 Hz as long as interrupt permit flag astart represents "1". 
Accordingly, there is no possibility that the transfer command tc be newly set to the 

10 instruction list 32a be overwritten by an unprocessed transfer co umand. 

The background process is executed according to a flowchart shown in Figure 16. 
First, in step S181 an execution mail no. E-mail_No is set at "0". Next, it is determined in 
step S183 whether the number of unprocessed mails Rem__Mail h greater than "0" or not. 
If "NO" herein, the process of step SI 83 is repeated, wherein the process advances to step 

15 S185 when Rem__Mail > 0 is reached. In step S185, an instructi<:>n for the currently 

executed mail no. E-mail__No is executed. That is, if the instruction content is "HEAD 
SEEK", a seek is made to a desired file address on the magneto-optical disk 36. If the 
instruction content is "WRITE", desired data is transferred from ttie magneto-optical disk 
36 to the SDRAM 28. When the instruction is executed, in step S187 the execution mail 

20 no. E-mail_No is incremented, and in step S189 the number of unprocessed mails 

Rem_Mail is decremented. In step S 191, it is determined whether the execution mail no. 
E-mail_No exceeded the maximum mail no. (MAX_BOX + 1) o:- not. If "NO", the 
process directly returns to the step S183 while, if "YES", the process returns to the step 
S181. 

25 As can be understood from the above explanation, if the reproduce mode is 
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data and sound data 



selected and the set key 56 is pressed, the CPU 32 concurrently makes a transfer process 
of compressed image data and sound data from the magneto-optical disk 36 to the 
SDRAM 28 and a reproducing process of the compressed imagq < 
stored in the SDRAM 28. 
5 Herein, the reproduce process includes a process of setting the transfer command 

of compressed image data and sound data (including seek and write operations) to the 
mstruction list 32a and a process of outputting the compressed im^ge data and sound data 
stored in the SDRAM 28. On the other hand, the transfer process includes a process of 
making reference to the instruction list 32a and seeking desired address on the magneto- 

10 optical disk 36 and a process of making reference to the instruction list 32a and writing 
desired data to a desired address of the SDRAM 28. 

In the case that data is sporadically recorded over the disk rlecording medium such 
as the magneto-optical disk 36, there is a case that the reading from the disk recording 
medium is delayed due to the cause of head seek. In such a case, where serially 

15 transferring data from the magneto-optical disk 36 to the SDRAM 28 or outputting the 
data stored in the SDRAM 28, there is a fear of partial delay in outputting the data. This 
possibly results in partial freeze in the output moving image when the reproduced data is 
moving image data, or partial break in the output sound when the reproduced data is 
sound data. 

20 Contrary to this, in this embodiment the CPU 32 is mounted With a real-time OS to 

concurrently execute the process of transferring data from the magnpto-optical disk 36 to 
the SDRAM 28 and the process of reproducing the data stored in the SDRAM. This can 
prevent against partial freeze in the reproduced moving image or pa^ial break in the 
reproduced sound. 

25 Also, the reproduce process includes a process of setting a pljj 



lality of operation 
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commands to the instruction list 32a and a process of decompressing and outputting the 
compressed image data stored in the SDRAM 28. On the other hand, the transfer process 
includes a process of making reference to the instruction list 322. and seeking a desired 
address on the magneto-optical disk 32a and a process of making reference to the 
instruction list 32a and transferring data, frame by frame, from tlie magneto-optical disk 
36 to the SDRAM 28. 

That is, a plurality of operation commands are set to the instruction list 32a by part 
of the reproduce process. In the transfer process concurrent with the reproduce process, a 
desired address on the magneto-optical disk 36 is sought by making reference to the 
instruction list 32a. By reference to the same instruction list 32a, the compressed image 
data is transferred, frame by frame, to the SDRAM 28. The compressed image data 
stored to the SDRAM 28 is outputted through a decompression pjocess. In this manner, a 
plurality of operation commands are accumulated in the instruction list 32a, wherein the 
operation to be next executed is fixed in the instruction list 32a. Accordingly, even when 
partial delay occurs due to seek operation, the operation command can be promptly 
processed after completing the seek operation. 

Incidentally, although this embodiment uses the magneto- optical disk as a disk 
recording medium, a hard disk may be used in place of the magneto-optical disk. Also, 
although this embodiment uses a file in the QuickTime type, an AVI (Audio Video 
Interleave) type file may be used instead thereof. Furthermore, although the moving 
image of this embodiment has a frame rate of 30 fps, the frame rate is not limited to this. 
Also, although this embodiment the Quicktime file recorded on tlie magneto-optical disk 
is managed by the FAT scheme, the file management scheme may be buy an UDF 
(Universal Disk Format) scheme. Furthermore, although this emlDodiment uses the CCD 
type image sensor, a CMOS-type image sensor may be used in place thereof. 
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Although the present invention has been described and illustrated in detail, it is 
clearly understood that the same is by way of illustration and example only and is not to 
be taken by way of limitation, the spirit and scope of the present invention being limited 
only by the terms of the appended claims. 
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